CLAIMS 



1 . A process for routing packets through a load balancing array of servers 
5 across a network in a computer environment, comprising the steps of: 

providing a plurality of load balancing servers; 
providing at least one back end Web server; 
wherein one of said load balancing servers is also a scheduler; 
wherein a request packet from a client is routed through said scheduler; 
1 0 wherein said scheduler routes and load balances said request packet to a 

load balancing server; 

wherein said load balancing server routes and load balances said request 
packet to a back end Web server; 

wherein said back end Web server's response packet to said request 
15 packet is sent to said load balancing server; and 

wherein said load balancing server sends said response packet directly to 
said client. 

2. The process of Claim 1 , wherein said scheduler routes and load balances 
client requests to itself. 

3. The process of Claim 1 f further comprising the steps of: 
detecting the failure of said scheduler; and 
electing one of said load balancing servers as the new scheduler. 

4. The process of Claim 1 , wherein said scheduler detects the failure of other 
load balancing servers; and wherein said scheduler stops routing packets to any 
failed load balancing servers. 

30 5. The process of Claim 1, wherein said load balancing server schedules 
sessions to back end Web servers based on a cookie or session ID. 
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6. The process of Claim 1 , wherein said load balancing server uses cookie 
injection to map a client to a specific back end Web server. 

7. The process of Claim 1 , wherein said load balancing server decrypts said 
5 request packet if it is an SSL session before routing and load balancing said 

request packet to a back end Web server. 

8. The process of Claim 7, wherein said load balancing server encrypts said 
response packet if it is an SSL session before sending said response packet 

1 0 directly to said client. 

9. The process of Claim 1 , wherein said load balancing server establishes a 
connection with said client and said client keeps said connection alive with said 
load balancing server. 

15 

10. The process of Claim 9, wherein said load balancing server performs URL 
based scheduling of request packets. 

1 1 . The process of Claim 9, wherein said load balancing server performs hash 
20 scheduling of request packets. 

12. The process of Claim 1, wherein said load balancing server maintains 
persistent connections in all its paths when required; and wherein said load 
balancing server uses hash group based persistence to maintain its persistence 

25 tables. 

13. The process of Claim 1, wherein said load balancing server detects if a 
back end Web server fails; and wherein said load balancing server stops routing 
request packets to failed back end Web servers. 

30 

14. The process of Claim 1 , further comprising the step of: 
providing a content delivery network; and 
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wherein said load balancing server modifies select URLs in the HTML 
page in said response packet to serve them from said content delivery network. 

15. The process of Claim 14, wherein HTML pages that have modified URLs 
5 are cached to improve performance. 

16. An apparatus for routing packets through a load balancing array of servers 
across a network in a computer environment, comprising: 

a plurality of load balancing servers; 
1 0 at least one back end Web server; 

wherein one of said load balancing servers is also a scheduler; 
wherein a request packet from a client is routed through said scheduler; 
wherein said scheduler routes and load balances said request packet to a 
load balancing server; 
1 5 wherein said load balancing server routes and load balances said request 

packet to a back end Web server; 

wherein said back end Web server's response packet to said request 
packet is sent to said load balancing server; and 

wherein said load balancing server sends said response packet directly to 
20 said client. 

17. The apparatus of Claim 16, wherein said scheduler routes and load 
balances client requests to itself. 

25 1 8. The apparatus of Claim 1 6, further comprising: 

a module for detecting the failure of said scheduler; and 
a module for electing one of said load balancing servers as the new 
scheduler. 

30 19. The apparatus of Claim 16, wherein said scheduler detects the failure of 
other load balancing servers; and wherein said scheduler stops routing packets 
to any failed load balancing servers. 
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20. The apparatus of Claim 16, wherein said load balancing server schedules 
sessions to back end Web servers based on a cookie or session ID. 

21. The apparatus of Claim 16, wherein said load balancing server uses 
5 cookie injection to map a client to a specific back end Web server, 

22. The apparatus of Claim 16, wherein said load balancing server decrypts 
said request packet if it is an SSL session before routing and load balancing said 
request packet to a back end Web server. 

10 

23. The apparatus of Claim 22, wherein said load balancing server encrypts 
said response packet if it is an SSL session before sending said response packet 
directly to said client. 

15 24. The apparatus of Claim 16, wherein said load balancing server 
establishes a connection with said client and said client keeps said connection 
alive with said load balancing server. 

25. The apparatus of Claim 24, wherein said load balancing server performs 
20 URL based scheduling of request packets. 

26. The apparatus of Claim 24, wherein said load balancing server performs 
hash scheduling of request packets. 

25 27. The apparatus of Claim 16, wherein said load balancing server maintains 
persistent connections in all its paths when required; and wherein said load 
balancing server uses hash group based persistence to maintain its persistence 
tables. 

30 28. The apparatus of Claim 16, wherein said load balancing server detects if a 
back end Web server fails; and wherein said load balancing server stops routing 
request packets to failed back end Web servers. 
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29. The apparatus of Claim 1 6, further comprising: 
a content delivery network; and 

wherein said load balancing server modifies select URLs in the HTML 
page in said response packet to serve them from said content delivery network. 

30. The apparatus of Claim 29, wherein HTML pages that have modified 
URLs are cached to improve performance. 
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